Method and system for controlling  external output of a mobile device

ABSTRACT

A method and system is provided that controls an external output function of a mobile device according to control interactions received via the microphone. The method includes, activating a microphone according to preset optional information when the mobile device enters an external output mode, performing an external output operation in the external output mode, detecting an interaction based on sound information in the external output mode, and controlling the external output according to the interaction.

PRIORITY

This application is a divisional application of a prior application Ser.No. 12/965,140, filed on Dec. 10, 2010, which claimed the benefit under35 U.S.C. §119(a) of a Korean patent application filed on Dec. 18, 2009in the Korean Intellectual Property Office and assigned Serial No.10-2009-0127136, the entire disclosure of each of which is herebyincorporated by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to electronic systems. More particularly,the present invention relates to a method and system that can controlscreen data output from a projector module installed as a component of amobile device, according to a microphone-based input interaction.

2. Description of the Related Art

With the development of digital technology, a variety of mobile deviceshave been released that can perform communication and process a user'sinformation while moving. Examples of the mobile devices are a mobilecommunication device, a Personal Digital Assistant (PDA), an electronicorganizer, etc. These mobile devices output screen data on their displayunits. In general, the display unit provided as a component of themobile devices is relatively small because the mobile devices aremanufactured small.

Frequently, a user desires to show information to other people via thedisplay unit of his/her mobile device. In that case, the user hasdifficulty viewing the information together with other people becausethe display unit is small. To address this problem, in recent years, themobile devices have been developed that are equipped with a TeleVision(TV)-Out function that can output information from the mobile devices toan external display system, so that many people can view theinformation. However, to this end, the mobile devices require anadditional large display system and a connection thereto via anadditional connector.

To address the problem of requiring the additional large display system,the mobile devices have been developed that have a projection functionthat can project a large image onto an external screen, for example.Herein, the projection function may be implemented with a projectorunit. In that case, the mobile device can output screen data on anexternal screen, such as a wall, floor, etc., via the projector unit. Amobile device with a projection function can project screen data,appearing on the display unit, onto an external screen.

The mobile device with a projector unit can be controlled by a wirelesscontrol unit that is separate from the mobile device, or by a mechanicalforce applied to a control unit (e.g., a button, a touch screen, or thelike) installed as a component of the mobile device.

In order to control the mobile device with a projector unit, when a userapplies a mechanical touch to the body of the mobile device, the mobiledevice may be shaken. When the mobile device outputting screen data tothe external screen in a user's set direction and angle is shaken, thescreen data is also shaken and varies its position on the externalscreen. For example, when a shake occurs while the mobile device isprojecting a presentation or a movie onto an external screen, the usermust operate the mobile device to correct for the shake. This may causethe disturbance in the presentation or a disturbance in an appreciationof the movie. The conventional mobile device with a projection functionrequires the user to re-adjust the position of the mobile device orre-set the options of the projection function in order to correct forthe shake.

In addition, when the mobile device employs the wireless control unit,the user must also carry the wireless control unit.

SUMMARY OF THE INVENTION

An aspect of the present invention is to address at least theabove-mentioned problems and/or disadvantages and to provide at leastthe advantages described below. Accordingly, an aspect of the presentinvention is to provide a method and system that can control a mobiledevice with a projector module so that the mobile device can control theoutput of screen data output to an external screen and the input forcontrolling the screen data.

Another aspect of the present invention is to provide a method andsystem that can simply and efficiently control the screen data, outputfrom a projector module installed as a component of a mobile device,without mechanically touching the mobile device.

Yet another aspect of the present invention is to provide a method andsystem that can control screen data output from a projector moduleinstalled as a component of a mobile device, according tomicrophone-based input interactions.

In accordance with an aspect of the invention, a method for controllingan external output of a mobile device is provided. The method includes,activating a microphone according to preset optional information whenthe mobile device enters an external output mode, performing an externaloutput operation in the external output mode, detecting an interactionbased on sound information in the external output mode, and controllingthe external output according to the interaction.

In accordance with another aspect of the invention, a mobile device isprovided. The mobile device includes, a projector module for outputtingscreen data from the mobile device to an external screen, a storage unitfor storing a preset keyword information and a preset optionalinformation related to an external output function of the mobile device,a microphone for receiving an interaction, and a controller foractivating the microphone according to the preset optional informationwhen the mobile device enters an external output mode, for performing anexternal output operation in the external output mode, for activating aninteraction receiving mode when detecting an audio signal correspondingto the preset keyword information, the audio signal being input to themicrophone, for detecting, in the interaction receiving mode, theinteraction input to the microphone to extract an input signal from thedetected interaction, for identifying a type of the detected interactionbased on the input signal, for performing a conversion for the inputsignal corresponding to the type of the detected interaction, and forcontrolling the external output according to a converted input signal.

Other aspects, advantages, and salient features of the invention willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses exemplary embodiments of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainexemplary embodiments of the present invention will be more apparentfrom the following description taken in conjunction with theaccompanying drawings, in which:

FIG. 1 illustrates a bar type mobile device having a full touch screen,according to an exemplary embodiment of the present invention;

FIG. 2 illustrates a bar type mobile device having a display unit and aninput unit, according to an exemplary embodiment of the presentinvention;

FIG. 3 illustrates a schematic block diagram of a mobile deviceaccording to an exemplary embodiment of the present invention;

FIG. 4 illustrates views that describe methods for controlling anexternal output of a mobile device, based on voice interactions,according to an exemplary embodiment of the present invention;

FIG. 5 illustrates views that describe methods for controlling anexternal output of a mobile device, based on blow interactions,according to an exemplary embodiment of the present invention;

FIG. 6 illustrates a flow chart that describes a method for controllingan external output of a mobile device by recognizing a user'sinteractions, according to an exemplary embodiment of the presentinvention; and

FIG. 7 illustrates a flow chart that describes a method for controllingan external output of a mobile device, based on microphone-basedinteractions, according to an exemplary embodiment of the presentinvention.

Throughout the drawings, it should be noted that like reference numbersare used to depict the same or similar elements, features, andstructures.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of exemplaryembodiments as defined by the claims and their equivalents. It includesvarious specific details to assist in that understanding but these areto be regarded as merely exemplary. Accordingly, those of ordinary skillin the art will recognize that various changes and modifications of theembodiments described herein can be made without departing from thescope and spirit of the invention. In addition, descriptions ofwell-known functions and constructions may be omitted for clarity andconciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of theinvention. Accordingly, it should be apparent to those skilled in theart that the following description of exemplary embodiments of thepresent invention is provided for illustration purpose only and not forthe purpose of limiting the invention as defined by the appended claimsand their equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

Prior to explaining the exemplary embodiments of the present invention,terminologies will be defined that are used in the present descriptionbelow. The terms or words described in the present description and theclaims should not be limited by a general or lexical meaning, andinstead should be analyzed as a meaning and a concept through which theinventor defines and describes the invention, to comply with the idea ofthe invention. Therefore, one skilled in the art will understand thatthe exemplary embodiments of the present invention disclosed in thedescription and illustrated in the drawings are only preferredembodiments. Accordingly, there may be various modifications,alterations, and equivalents thereof to supplement or replace theexemplary embodiments of the present invention at the time of filingthis application.

Exemplary embodiments of the present invention relate to a method andsystem for controlling an external output of a mobile device with aprojector unit. In particular, the exemplary embodiments of the presentinvention relate to a method and system that can control an externaloutput function of the mobile device, according to an interactionreceived by a microphone, when the mobile device outputs screen data toan external screen through the projector unit.

The method and system can receive control interactions via a microphone,regardless of a user's environment (e.g., a dark or bright place), whena mobile device outputs screen data, and can then control the externaloutput of the mobile device, according to the received controlinteractions. The method and system can recognize audioinformation-based interactions, such as a user's voice interaction or ablow interaction, via the microphone. The method and system can controlscreen data that is being output to an external screen, according tointeractions received by the microphone, irrespective of a user'senvironment.

The mobile device of an exemplary embodiment of the present inventionincludes a projector module, a microphone, and a controller. Themicrophone serves to recognize a user's control interactions while theprojector module of the mobile device is outputting screen data onto anexternal screen. The controller analyzes the interactions transferredfrom the microphone and performs a controlling operation correspondingthereto. In an exemplary embodiment of the present invention, themicrophone may be implemented with an internal microphone installed as acomponent of the mobile device or an external microphone installed as acomponent of external devices, such as a Bluetooth headset, etc.

The following description illustrates the configuration of the mobiledevice with a projector module according to an exemplary embodiment ofthe present invention. It should be understood that the presentinvention is not limited to the exemplary embodiments. It will be notedthat there may be many modifications from the exemplary embodimentsdescribed herein.

FIGS. 1 and 2 illustrate exemplary implementations of the mobile deviceaccording to exemplary embodiments of the invention. More specifically,FIG. 1 illustrates a bar type mobile device having a full touch screen,according to an exemplary embodiment of the present invention, and FIG.2 illustrates a bar type mobile device having a display unit and aninput unit.

Referring to FIGS. 1 and 2, the mobile device includes a display unit100 for displaying screen data according to the execution of acorresponding function, an input unit 200 for creating a user's inputsignals, a projector module 300 for enlarging and projecting screen dataonto an external screen, a focus control unit 350 for controlling thefocus of the projector module 300, a speaker SPK for outputting varioustypes of audio signals according to the execution of a correspondingfunction, a microphone MIC for receiving external audio signals, such asa user's voice, etc.

In an exemplary embodiment of the present invention, the microphonereceives a user's voice or a blow from the user while the mobile deviceis outputting screen data onto an external screen via the projectormodule 300. The microphone may be implemented with an internalmicrophone installed as a component of the mobile device or an externalmicrophone installed as a component of an external device.

Although, in an exemplary embodiment of the present invention, themicrophone is installed as a component of the mobile device as shown inFIGS. 1 and 2, it should be understood that its installation location isnot limited to these exemplary embodiments. It can also be installed atother locations of the mobile device in order to properly control theexternal output of the mobile device, depending on the type of themobile device.

In addition, although the mobile devices shown in FIGS. 1 and 2 areimplemented to include one microphone, respectively, it should beunderstood that the invention is not limited to these exemplaryembodiments. For example, the mobile device may be implemented withoutan internal microphone. In that case, the mobile device is operated viaan external microphone installed as a component of an external device.In another exemplary embodiment of the present invention, the mobiledevice can be implemented with a number of microphones. For example, asshown in FIGS. 1 and 2, the mobile device includes at least two or moremicrophones, which are referred to as a multi-microphone. If the mobiledevice is implemented with two microphones, they may be located in thetop and bottom or the right and left with respect to the front side.Likewise, if the mobile device is implemented with four microphones,they may be located in the top, bottom, right, and left.

In another exemplary embodiment of the present invention, the microphoneMIC can be replaced with or supplemented by a voice recognition modulethat has the same function as the microphone MIC.

As described above, the mobile device can respond a user's interactionsusing the same or different types of microphones. For example, if themobile device is implemented with two microphones located in the top andbottom, the mobile device can be set in such a way that a user'sinteractions are responded to differently from each other, respectively,so that the mobile device can output data corresponding to the differentinteractions. That is, although the top and bottom microphones receiveand recognize the same voice, they can respond to a user's interactionsthat differ from each other and control functions corresponding to thedifferent interactions, respectively.

In an exemplary embodiment of the present invention, although the mobiledevice with a projector module are described herein based on a bar typeas shown in FIGS. 1 and 2, it will be appreciated that the presentinvention similarly applies to all types of mobile devices, for example,a folder type, a slide type, a flip-flop type, etc. The mobile devicecan be applied to all information communication devices, multimediadevices, and their applications, if they can control an external outputfunction according to the operation of a microphone. For example, themobile device can be applied to all types of mobile communicationterminals that are operated according to communication protocolscorresponding to a variety of communication systems and also torelatively small-sized devices, for example, a Portable MultimediaPlayer (PMP), a digital broadcast player, a Personal Digital Assistant(PDA), an audio player (e.g., a Moving Picture Experts Group (MPEG)-1 orMPEG-2 Audio Layer 3 (MP3) player), a mobile game player, a smart phone,etc. The mobile device can also be applied to relatively mid-sized andlarge-sized devices, for example, a TeleVision (TV) set, a Large FormatDisplay (LFD), a Digital Signage (DS), a media pole, a personalcomputer, a laptop computer, etc.

The following description explains the elements of the mobile devicewith a projector module, referring to FIG. 3. FIG. 3 shows the mobiledevice with a projector module, including a microphone, i.e., aninternal microphone, according to an exemplary embodiment of the presentinvention. In another exemplary embodiment of the present invention, themobile device can be implemented without the internal microphone. Inthat case, the mobile device can employ its microphone function via anexternal device with a microphone, i.e., an external microphone, forexample, a Bluetooth headset, a wired or wireless external microphone.When the mobile device of the invention is operated via an externaldevice with a microphone, it can further include an interface forreceiving audio signals from the external device.

FIG. 3 illustrates a schematic block diagram of a mobile deviceaccording to an exemplary embodiment of the present invention.

Referring to FIG. 3, the mobile device includes a display unit 100, aninput unit 200, a projector module 300, an audio processing unit 400, astorage unit 500, and a controller 600.

The input unit 200 outputs input signals corresponding to numerical andtext information, signals for setting functions of the mobile device,and control signals related to the function to the controller 600. Theinput unit 200 creates command signals related to the entire operationof the mobile device. The input unit 200 includes function keys andinput keys for creating the signals. The function keys include directionkeys, side keys, shortcut keys, etc., which are set to perform specificfunctions (e.g., a projection function). In addition, the input unit 200may further include a focus adjustment unit for adjusting the focus ofthe projector module 300 as shown in FIGS. 1 and 2.

The input unit 200 may be implemented by one of a touch pad, a touchscreen, a keypad of a general key arrangement (e.g., a 3×4 or 4×3 keyarrangement), a QWERTY keypad, a dome key, or a combination thereof. Inparticular, the input unit 200 creates an input signal for executing aprojection function and outputs the input signal to the controller 600.The input signal for executing a projection function may be a key signalcreated by operating the input unit 200. Alternatively, if the mobiledevice is equipped with a touch screen, the input signal for executing aprojection function may be created by touching the touch screen.

The audio processing unit 400 includes a speaker SPK for reproducingaudio signals from the mobile device, and a microphone MIC for receivingaudio signals such as a user's voice. The audio processing unit 400connects to the speaker SPK and the microphone MIC. The audio processingunit 400 converts audio signals, received by the microphone MIC, intodigital data and then outputs the digital data to the controller 600.The audio processing unit 400 also receives audio signals from thecontroller 600 and outputs the audio signals via the speaker SPK. Theaudio processing unit 400 can also output various types of audio signalscreated in the mobile device, according to the user's selection. Theaudio signals include signals created as video or audio data isreproduced, a signal for generating an alarm sound according to theexecution of the projection function, etc.

In an exemplary embodiment of the present invention, the audioprocessing unit 400 receives control interactions for controlling anexternal output function via the microphone MIC when the mobile deviceis operated in an external output mode. The audio processing unit 400creates data from the control interactions and transfers the data to thecontroller 600. That is, the audio processing unit 400 receives a voiceinformation-based interaction via the microphone MIC in an externaloutput mode. The voice information-based interaction includes a voiceinteraction, based on a user's voice, and a blow interaction based on auser's blow.

When the mobile device is operated in an external output mode, themicrophone MIC can be operated in an always-listening mode ornormal-listening mode, under the control of the controller 600. Thealways listening mode refers to a mode where the mobile device turns onthe microphone MIC so that the microphone MIC can receive a user's voiceor blow when the mobile device is operated in an external output mode.The normal listening mode refers to a mode where the microphone MIC isturned from off to on or vice versa, according to a user's selection,when the mobile device is operated in an external output mode.

The display unit 100 outputs various types of screens when correspondingfunctions are performed in the mobile device. For example, the displayunit 100 can display a booting screen, an idle screen, a menu screen, alist screen, a playback screen, application executing screens of themobile device, etc. The display unit 100 displays screen data related tothe states and operations of the mobile device. The display unit 100 canalso display signals and color information output from the controller600. The display unit 100 can be implemented with a Liquid CrystalDisplay (LCD), a Plasma Display Panel (PDP), a Light Emitting Diode(LED), an Organic LED (OLED), an Active Matrix OLED (AMOLED), or thelike. If the display unit 100 is implemented with a touch screen, thetouch screen can also serve as an input device. In that case, the mobiledevice according to the invention can be configured without the inputunit 200.

In an exemplary embodiment of the present invention, when the mobiledevice is operated in an external output mode, i.e., when the mobiledevice performs a projection function, the display unit 100 displaysscreen data, output from the controller 600, or a virtual item based ona Graphic User Interface (GUI) for controlling the external outputfunction. When the mobile device performs the projection function, thedisplay unit 100 can display screen data that is identical to or differsfrom the screen data output to an external screen, according to thecontrol of the controller 600. It is assumed that the screen datadisplayed on the display unit 100 is referred to as ‘internal screendata’ and the screen data displayed on the external screen is referredto as ‘external screen data.’ For example, the display unit 100 candisplay a GUI serving as a virtual item for controlling the externaloutput function, on an image corresponding to the internal screen data,according to the control of the controller 600.

The storage unit 500 stores data created or used in the mobile device.The data refers to all data that are created by the mobile device orreceived from external systems (e.g., other external mobile devices,personal computers, etc.). Examples of the data are video data, audiodata, broadcast data, photograph data, message data, text data, imagedata, etc. The storage unit 600 can store applications for executingcorresponding functions in the mobile device. An example of theapplications is the execution of a projection function in the mobiledevice. The storage unit 500 can store a virtual item for controlling aprojection function when the projection function is activated. Thestorage unit 500 can also store software for controlling a function ofscreen data that the projector module 300 is currently outputting to anexternal screen.

The storage unit 500 stores the optional information for the externaloutput function of the mobile device. The optional information includesreceiving mode information, keyword information, etc. The receiving modeinformation is used to operate the microphone MIC when the mobile deviceis operated in an external output mode. The keyword is used to identifycontrol interactions for controlling the external output.

The receiving mode information refers to information for setting thealways listening mode and normal listening mode.

The keyword information refers to information about keywords foridentifying a user's normal voice and a voice for controlling anexternal output. The keyword information includes a magic keyword and acommand keyword. The magic keyword serves to activate an interactionreceiving mode for controlling an external output when the mobile deviceis operated in an external output mode. The command keyword serves toidentify a user's voice or blow received via the microphone MIC when theinteraction receiving mode is activated according to the magic keyword.Table 1 is shown below as an example of the keyword information.

TABLE 1 Keyword Info. Commands Functions Magic Magic Switch betweenactivation and Keyword deactivation of interaction receiving modeCommand Voice Play Playback keywords Pause Pause Next Turn to nextpage/move channel Previous Turn to previous page/move channel ForwardFast forward Rewind Rewind Vol. up Volume increase Vol. Volume decreasedown Zoom in Zoom in Zoom Zoom out out Power Turn on an external outputfunction on Power Turn off an external output function off For onemicrophone For two microphones MIC 1^(st) MIC 2^(nd) MIC Blow T_(B) < TPause Pause Playback T ≦ T_(B) Playback Turn to next Turn to page/moveprevious channel page/move channel T_(B) < T Pause Playback Pause S_(B)< S T_(B) < T Playback Turn to next Turn to S ≦ S_(B) page/move previouschannel page/move channel T ≦ T_(B) Turn to next Fast forward RewindS_(B) < S page/move channel T ≦ T_(B) Turn to Volume Volume S ≦ S_(B)previous increase decrease page/move channel

In Table 1, T denotes a preset reference time and S denotes a presetreference strength value.

As described in Table 1, the keyword information is divided into themagic keyword and the command keyword. The magic keyword refers to acommand for activating an interaction receiving mode. In an interactionreceiving mode, the mobile device can receive a voice or blowinteraction for controlling screen data, output to an external screenvia the projector module 300, when the mobile device is operated in anexternal output mode. That is, when the mobile device is operated in anexternal output mode and the microphone is also operated in an alwayslistening mode, the mobile device can receive a user's normal voices,audio signals created when an application executes video data or audiodata, and noise, via the microphone MIC. The user's normal voice refersto user's voice when it does not contain control commands. In anexemplary embodiment of the present invention, the mobile device ignoresthe audio signals, input to the microphone MIC before activating aninteraction receiving mode by the magic keyword. That is, the mobiledevice does not process such audio signals as an interaction forcontrolling an external output. The mobile device continues, however, todetermine whether an audio signal corresponding to a preset magickeyword (e.g., the ‘Magic’ described in Table 1) is received via themicrophone MIC.

The command keywords refer to commands for controlling an externaloutput function based on audio signals that are input when aninteraction receiving mode is activated according to the magic keyword.The commands serving as the command keyword are divided into the voicecommand group and blow command group as described in Table 1. It shouldbe understood that one command in the command keyword can be set toperform various types of functions according to the operation modes ofthe microphone MIC.

The commands available for the voice commands, as described in Table 1,serve to perform the following functions: ‘Play’, ‘Pause’, ‘Next’,‘Next’, ‘Previous’, ‘Forward’, ‘Rewind’, ‘Volume up’, ‘Volume down’,‘Zoom in’, ‘Zoom out’, ‘Power on’, ‘Power off’, etc. The voice commandsand the functions corresponding thereto, as default values, can be setto be performed in the mobile device when they are manufactured.Alternatively, the voice commands can also be set in the mobile deviceaccording to a user's selection.

The commands available for the blow commands can be classified as shownin Table 1, based on preset reference values.

When the mobile device employs one microphone, the blow commands can settheir functions based on at least one of reference values, i.e., apreset length of time of receiving a blow T (referred to as a ‘referencetime T’) and a preset reference strength value of receiving a blow S(referred to as a ‘reference strength value S’). In that case, a lengthof time of receiving a blow T_(B) (referred to as a ‘blow receiving timeT_(B)’) is set as follows. Here T_(B) is less than T or T_(B) is equalto or greater than T, for example. Likewise, a strength value ofreceiving a blow S_(B) (referred to as a ‘blow receiving strength valueS_(B)’) is set as follows. Here S_(B) is less than S or S_(B) is equalto or greater than S, for example. Alternatively, the blow commands canalso set their functions based on a combination of the ‘reference timeT’ and the ‘reference strength value S’. That is, a command can be setas follows. Here, ‘T_(B) is less than T and S_(B) is less than S’,‘T_(B) is less than T and S_(B) is equal to or greater than S’, ‘T_(B)is equal to or greater than T and S_(B) is less than S’ and ‘T_(B) isequal to or greater than T and S_(B) is equal to or greater than S.’ Theblow commands and the functions corresponding thereto can be set to beperformed in the mobile device, based on at least one of the referencetime T and the reference strength value S, as a default value, when theyare manufactured. Alternatively, the blow commands can also be set inthe mobile device according to a user's selection.

Although Table 1 shows an example when the voice commands are managedusing one microphone, it should be understood that they can also be setusing two microphones. In addition, although Table 1 describes anexample using one or two microphones, it should be understood that theinvention is not limited to these exemplary embodiments. For example,the mobile device can also be implemented with two or more microphones.In that case, the microphones may be achieved by a combination ofinternal microphones and external microphones.

It should be understood that the keyword information, the commands andthe functions corresponding to the commands, described in Table 1, canbe provided to mobile devices, as default values, and they can beedited, such as modification, deletion, and addition, according to auser's settings.

The storage unit 500 adds display information to optional informationand stores it. The display information sets display modes of a virtualitem for controlling a function of screen data that is output to anexternal screen according to the execution of an application. Thedisplay information is used to display at least one of the commands setby the user, which can be executed while a corresponding application isrunning, on the screen data displayed on the external screen, referredto as external screen data, and/or the screen data displayed on thedisplay unit 100, referred to as internal screen data, when aninteraction receiving mode is activated according to the magic keyword.The command refers to executable command information and can bedisplayed on the internal screen data and/or external screen data in theformat of pop-up window. In addition, the storage unit 500 may furtheradd a display mode of execution information, stating that acorresponding function is controlled and executed according to aparticular command, to the display information as well as the displayinformation for showing a display mode of executable commandinformation, and stores it.

The storage unit 500 includes at least one or more buffers thattemporarily store data generated while the mobile device is executed.For example, the storage unit 500 buffers screen data that is output toan external screen via the projector module 300. In addition, thestorage unit 500 also buffers audio signals received via the microphoneMIC when the mobile device is operated in an external output mode.

The storage unit 500 may also be implemented with all types of recordingmedia that can be installed inside or outside the mobile device, forexample, a smart card. The storage unit 500 may include Radom AccessMemory (RAM), Read Only Memory (ROM), or flash memory, or a combinationthereof. The storage unit 500 may include one or two integrated memory,for example, Multi-Chip Package (MCP) memory, etc.

The projector module 300 can be internally or externally installed as acomponent of the mobile device. The projector module 300 outputs screendata, provided by the controller 600, to an external screen via thelens. The projector module 300 can project screen data processed by thecontroller 600 to an external screen without distortion.

The controller 600 controls the operations of the mobile device and alsosignals flowing among the elements in the mobile device. Examples of theelements are the input unit 200, audio processing unit 400, display unit100, storage unit 500, projector module 300, etc.

The controller 600 controls an external output via the projector module300. The controller 600 processes the audio signals, received via themicrophone MIC, as interactions for controlling functions of the mobiledevice. The controller 600 controls an external output functionaccording to a received interaction. That is, the controller 600 cancontrol an external output function according to an interaction receivedvia the microphone MIC. When the mobile device enters an external outputmode, the controller 600 controls the microphone based on the receptionmode information contained in the optional information. When the mobiledevice is operated in an external output mode, the controller 600analyzes the audio signals received via the microphone. When theanalyzed audio signal corresponds to preset keyword information, thecontroller 600 creates an interaction corresponding to the keywordinformation and controls an external output function according to theinteraction.

The controller 600 outputs the screen data via the display unit 100,which is called internal screen data, and also the screen data via theprojector module 300, which is called external screen data, when themobile device performs the projection function. In particular, when theprojector module 300 outputs the screen data of a particular applicationon an external screen, the controller 600 may turn off the display unit100 or may not display the internal screen data on the display unit 100.Alternatively, the controller 600 can display the same screen data onboth the display unit 100 and the external screen. In that case, theinternal screen data is identical to the external screen data. Inaddition, the controller 600 can also display different screen data onthe display unit 100 and the external screen. In that case, the internalscreen data differs from the external screen data. For example, theinternal screen data as a User Interface (UI) provided by the mobiledevice can be displayed on the entire screen. The external screen datacan be displayed in such a way that corresponding screen data,reproduced/executed according to an application, is enlarged and thenoutput to an external screen.

As described above, the controller 600 can control functions of themobile device in an external output mode. To this end, the controller600 further includes an input signal extractor 610, a Speech-To-Text(STT) converter 630, a comparator 650, and an interaction processor 670.

The input signal extractor 610 extracts an input signal from aninteraction that is input to the microphone and transferred from theaudio processing unit 400. The input signal may be an audio signalcorresponding to a voice or a blow. The input signal extractor 610identifies whether the input signal corresponds to a voice-basedinteraction or a blow-based interaction and outputs the identifiedresult.

The STT converter 630 performs an audio signal, extracted by the inputsignal extractor 610, to a text. To this end, the STT converter 630includes an STT converting unit for converting an audio signal to a textand a sound pressure converting unit for converting an audio signal to asound pressure signal. When the audio signal, extracted by the inputsignal extractor 610, corresponds to a voice-based interaction, the STTconverter 630 converts the audio signal to a text signal via the SSTconverting unit. Likewise, when the audio signal, extracted by the inputsignal extractor 610, corresponds to a blow-based interaction, the STTconverter 630 converts the audio signal to a sound pressure signal viathe sound pressure converting unit. The STT converter 630 transfers theconverted text signal and the converted sound pressure signal to thecomparator 650.

The comparator 650 compares the text of the text signal, transferredfrom the STT converter 630, with the voice commands in the presetkeyword information described in Table 1. Likewise, the comparator 650compares the sound pressure signal, transferred from the STT converter630, with the blow commands in the preset keyword information describedin Table 1. The comparator 650 transfers the comparison results to theinteraction processor 670. The comparator 650 can compare a text signalor sound pressure signal, received before the interaction receiving modeis activated, with the magic keyword in the keyword information.Likewise, the comparator 650 can compare a text signal or sound pressuresignal, received after the interaction receiving mode is activated, withthe command keyword (i.e., a voice command or blow command) in thekeyword information. The comparator 650 outputs the result information,according to the comparison whether the text signal or sound pressuresignal matches a corresponding keyword in the keyword information, tothe interaction processor 670.

The interaction processor 670 processes an input signal-basedinteraction received via the microphone, according to the comparisonresult of the comparator 650. When the text signal or sound pressuresignal does not match the keyword information, the interaction processor670 ignores the input signal received via the microphone, and skips thecreation of interaction by the input signal. On the contrary, when thetext signal or sound pressure signal matches the keyword information,the interaction processor 670 creates an interaction for executing afunction to which the matched command is mapped and controls an externaloutput function according to the interaction.

As described above, when the mobile device performs an external outputfunction via the projector module 300, the controller 600 receives aninteraction, input to the microphone, from the audio processing unit 400and extracts an input signal according to the interaction via the inputsignal extractor 610. The input signal may be an audio signalcorresponding to a voice or a blow. The controller 600 identifieswhether the interaction is a voice-based interaction or a blow-basedinteraction. When the mobile device is operated in an external outputmode, the controller 600 receives a user's input signal according to amicrophone-based interaction and determines whether an interactionreceiving mode is activated or deactivated. When an interactionreceiving mode is deactivated, the controller 600 compares the inputsignal with the magic keyword. When the controller 600 ascertains thatthe input signal matches the magic keyword, it activates the interactionreceiving mode and waits for the reception of an interaction forcontrolling an external output. On the contrary, when an interactionreceiving mode is activated, the controller 600 compares the inputsignal with the command keyword. When the controller 600 ascertains thatthe input signal matches the command keyword, it controls an externaloutput based on a corresponding command.

When the controller 600 ascertains that the interaction is a voiceinteraction, the STT converter 630 converts the audio signal, extractedby the input signal extractor 610, into a text signal and creates atext. This can be achieved by the STT converting function. Thecontroller 600 controls the comparator 650 to compare the created textwith the keyword information stored in the storage unit 500. Thecontroller 600 compares the interaction, received before the interactionreceiving mode is activated, with the magic keyword in the keywordinformation. On the contrary, the controller 600 compares theinteraction, received after the interaction receiving mode is activated,with the command keyword in the keyword information.

The controller 600 processes a corresponding interaction according tothe comparison result of the comparator 650. That is, when the text doesnot match the keyword information, the interaction processor 670 ignoresthe input signal and skips the creation of interaction. On the contrary,when the text matches the keyword information, the interaction processor670 creates a control interaction according to a voice command matchingthe keyword information and controls an external output functionaccording to the created control interaction.

Likewise, when the controller 600 ascertains that the interaction is ablow interaction, the STT converter 630 converts the audio signal,extracted by the input signal extractor 610, into a sound pressuresignal. This can be achieved by the audio signal-to-sound pressuresignal converting function. The controller 600 controls the comparator650 to compare the sound pressure signal with the keyword informationstored in the storage unit 500. The controller 600 compares theinteraction, received before the interaction receiving mode isactivated, with the magic keyword in the keyword information. On thecontrary, the controller 600 compares the interaction, received afterthe interaction receiving mode is activated, with the command keyword inthe keyword information.

The controller 600 processes a corresponding interaction according tothe comparison result of the comparator 650. That is, when the soundpressure signal does not match the keyword information, the interactionprocessor 670 ignores the input signal and skips the creation ofinteraction. On the contrary, when the sound pressure signal matches thekeyword information, the interaction processor 670 creates a controlinteraction according to a blow command matching the keyword informationand controls an external output function according to the createdcontrol interaction.

When the controller 600 controls the interaction receiving mode to beactivated or deactivated according to the procedure described above, itcan display executable command information on at least one of theinternal screen data and the external screen data based on the displayinformation in the optional information. In addition, when thecontroller 600 controls an external output function according to aninteraction that is received after the executable command information isdisplayed in the activated interaction receiving mode, it can alsodisplay execution information stating that a function corresponding toat least one of the internal screen data and the external screen data isexecuted based on the display information.

The controller 600 controls an external output according to theoperation modes of the microphone MIC. That is, when the mobile deviceemploys a single microphone MIC, the controller 600 processes the audiosignal input to the single microphone MIC as an interaction as describedin Table 1 and controls an external output function based on theinteraction. When the mobile device employs a number of microphones, thecontroller 600 processes the audio signals input to correspondingmicrophones as interactions as described in Table 1 and controls anexternal output function based on the interactions.

For example, the controller 600 can distinguish between an interactionaccording to an audio signal input to a first microphone and aninteraction according to an audio signal input a second, and can thenprocess them as described in Table 1. When the user inputs a blow to thefirst microphone for a blow receiving time T_(B) less than the referencetime T, the controller 600 can control a pause function according to theblow interaction, referring to Table 1. Likewise, when the user inputs ablow to the second microphone for a blow receiving time T_(B) less thanthe reference time T, the controller 600 can control a playback functionaccording to the blow interaction. As such, although the user appliesthe same input signal to the mobile device, the mobile device canperform different functions according to which the microphones receivethe input signal.

The operations of the controller 600 will be described in detail, later,referring to the accompanying drawings. The controller 600 can controlthe entire operation related to the external output function accordingto the operation of the projector module 300. It should be understoodthat the control operation of the controller 600 can also be implementedwith software having an algorithm.

In an exemplary embodiment of the present invention, although FIGS. 1and 3 schematically show the configuration of the mobile device for thesake of convenience, it should be understood that the invention is notlimited to these exemplary embodiments.

The controller 600 may include a baseband module for allowing the mobiledevice to provide a mobile communication service. In that case, themobile device may further include an RF communication module forestablishing a communication channel with a mobile communication systemand allowing the mobile device to communicate with the mobilecommunication system. Although it is not shown in FIGS. 1 to 3, themobile device may further include a location information receiver foracquiring location information about the mobile device, such as a GlobalPositioning System (GPS) module, a camera module for capturing stillimages or moving images, a camera module for supporting a video callservice, a Bluetooth communication module for supporting Bluetoothcommunication, interface units for transmitting and receiving data inwired or wireless mode of the mobile device, an Internet communicationmodule for supporting an Internet function via the Internet, a digitalbroadcast module for receiving and reproducing digital broadcasts, etc.In another embodiment, it will be appreciated that, according to thepurposes, the mobile device may be implemented by omitting a particularelement from the configuration shown in FIGS. 1 to 3 or replacing itwith other elements.

The foregoing description explained the configuration of the mobiledevice according to exemplary embodiments of the present invention. Thefollowing description explains the operations of the mobile device witha projection function and the method for controlling the external outputfunction based on the projector module 300 with reference to theaccompanying drawings. It should be, however, understood that theinvention is not limited to the following exemplary embodiments. It willbe noted that there may be many modifications from the exemplaryembodiments.

FIG. 4 illustrates views that describe methods for controlling anexternal output of a mobile device, based on voice interactions,according to an exemplary embodiment of the present invention.

Referring to FIG. 4, diagram 401 shows a state where the mobile deviceoutputs screen data to an external screen 900 via the projector module300. When a user operates the mobile device to execute an application,the mobile device outputs screen data onto the external screen 900 viathe projector module 300. The external screen 900 refers to a screen onwhich the projector module 300 projects the screen data. Examples of theexternal screen 900 are a component (e.g., a white screen, etc.)installed to an external system, a wall, a floor, etc. It will beappreciated that the external screen 900 may be any type of object thatthe projector module 300 can project the screen data onto and displaythe screen data. The screen data may be dynamic screen data reproducedby a playback application (e.g., a moving image playback application, adigital broadcast playback application, etc.). The screen data may alsobe static screen data displayed by a viewer application (e.g., a textviewer application, an image viewer application, etc.).

While the screen data is being displayed on the external screen 900 asshown in diagram 401, the user can create an interaction to control thescreen data. For example, the user can input his/her voice into aninternal microphone of the mobile device or an external microphoneinstalled as a component of an external device (e.g., a Bluetoothheadset, etc.) when the mobile device outputs the screen data onto theexternal screen 900 as shown in diagrams 401 and 403. Diagrams 401 and403 show examples where the user inputs his/her voice corresponding to akeyword (e.g., ‘Magic’ described in Table 1) for activating aninteraction receiving mode. In an exemplary embodiment of the presentinvention, the keyword for activating an interaction receiving mode canbe set to a blow keyword corresponding to the condition ‘T_(B)<T andS≦S_(B).’ In that case, the user can activate an interaction receivingmode, by inputting a blow into the microphone, thereby satisfying thecondition ‘T_(B)<T and S≦S_(B)’.

The controller 600 receives an input signal corresponding to the user'svoice via the microphone and identifies whether it corresponds to avoice interaction or a blow interaction. Diagrams 401 and 403 show anexample where the input signal is a voice interaction. The controller600 converts the input signal of the voice interaction into a text via aSTT conversion and compares the text with a magic keyword in the keywordinformation.

When the controller 600 ascertains that the text matches a magickeyword, it activates an interaction receiving mode and then outputsexecutable command information 800 as shown in diagram 403. Theexecutable command information 800 refers to information about commandsthat can be executed on the current output. When the controller 600activates an interaction receiving mode, it outputs the executablecommand information 800 on at least one of the internal screen data andthe external screen data, referring to preset optional information(i.e., display information). It should be understood that the executablecommand information 800 may not be displayed according to a user'ssettings.

After that, the user can create an interaction for controlling anexternal output function, referring to the executable commandinformation 800 output as shown in diagram 403. For example, the usercan input his/her voice to the internal microphone or the externalmicrophone. Diagram 403 shows an example where the user inputs his/hervoice, corresponding to a keyword (e.g., volume increase) forcontrolling an external output function, to the microphone.

The controller 600 receives an input signal corresponding to the user'svoice via the microphone and identifies whether the input signalcorresponds to a voice interaction or a blow interaction. Diagram 403shows an example where the input signal is a voice interaction. Thecontroller 600 converts the input signal of the voice interaction into atext via a STT conversion and compares the text with a command keyword(i.e., a voice keyword) in the keyword information.

When the controller 600 ascertains that the text matches a particularkeyword of the command keywords, it controls a function corresponding tothe matched command (e.g., volume increase) in the keyword commands asshown in diagram 405. For example, the controller 600 canincrease/decrease in the audio volume (e.g., volume increase accordingto the command), based on the recognized command, while the screen datais being output. The controller 600 can also control various functionsdescribed in Table 1, according to corresponding recognized commands.

When the controller 600 controls a function based on the commands, itcan output execution information 850 stating that a control function isperformed on the current external output as shown in diagram 405. Whenthe controller 600 controls the output of the execution information 850,it can output the execution information 850 on at least one of theinternal screen data and the external screen data, referring to presetoptional information (i.e., display information). It should beunderstood that the execution information 850 may not be displayedaccording to a user's settings. The execution information 850 may bedisplayed, as an icon or a text, on at least one of the internal screendata and the external screen data, for a preset period of time or duringthe function control operation. That is, the execution information maybe displayed on the internal screen data or the external screen datauntil a preset time period has elapsed, and then removed therefrom. Inaddition, the execution information may be displayed on the internalscreen data or the external screen data before a corresponding functionis released, and then removed therefrom.

After controlling a particular function for the external output as shownin diagram 405, the controller 600 can continue controlling anotherfunction. The user can re-call the executable command information 800 byinputting his/her voice corresponding to a magic keyword as shown indiagram 403 or can directly control another function by inputtinghis/her voice (i.e., a voice interaction or a blow interaction)corresponding to a command keyword as shown in diagram 405. Therefore,the controller 600 can compare the input signals, received when theinteraction receiving mode has been activated as shown in diagram 401,with both the magic keywords and the command keywords. After that, thecontroller 600 can perform a corresponding function according to thematched keyword.

On the contrary, when a corresponding function for the external outputhas been controlled as shown in diagram 405, the user may continueviewing corresponding screen data. When the controller 600 does notreceive a new input signal via the microphone within a preset timeperiod, the controller 600 can switch the interaction reception modefrom the activation state to the deactivation state.

FIG. 5 illustrates views that describe methods for controlling anexternal output of a mobile device, based on blow interactions,according to an exemplary embodiment of the present invention.

Referring to FIG. 5, diagram 501 shows a state where the mobile deviceoutputs screen data to an external screen 900 via the projector module300. When a user operates the mobile device to execute an application,the mobile device outputs screen data onto the external screen 900 viathe projector module 300. The screen data may be dynamic screen datareproduced by a playback application or static screen data displayed bya viewer application.

While the screen data is being displayed on the external screen 900 asshown in diagram 501, the user can create an interaction to control thescreen data. For example, the user can input his/her voice into aninternal microphone of the mobile device or an external microphoneinstalled as a component of an external device when the mobile deviceoutputs the screen data onto the external screen 900 as shown indiagrams 501 and 503. Diagrams 501 and 503 show examples where the userinputs his/her voice corresponding to a keyword (e.g., ‘Magic’ describedin Table 1) for activating an interaction receiving mode. In anexemplary embodiment of the present invention, the keyword foractivating an interaction receiving mode can be set to a blow keywordcorresponding to the condition ‘T_(B)<T and S≦S_(B).’ In that case, theuser can activate an interaction receiving mode, by inputting a blowinto the microphone, satisfying the condition ‘T_(B)<T and S≦S_(B).’

The controller 600 receives an input signal corresponding to the user'svoice via the microphone and identifies whether it corresponds to avoice interaction or a blow interaction. Diagrams 501 and 503 show anexample where the input signal is a voice interaction. The controller600 converts the input signal of the voice interaction into a text via aSTT conversion and compares the text with a magic keyword in the keywordinformation.

When the controller 600 ascertains that the text matches a magickeyword, it activates an interaction receiving mode. Although it is notshown in FIG. 5, the controller 600 can output the executable commandinformation 800 on at least one of the internal screen data and theexternal screen data, in the activated interaction receiving mode, asshown in diagram 403 of FIG. 4.

After an interaction corresponding to the magic keyword is created andan interaction receiving mode is activated, the user can create anotherinteraction for controlling an external output function as shown indiagram 503. For example, the user can input his/her voice to theinternal microphone of the mobile device or the external microphone ofan external device. Diagram 503 shows an example where the user inputs ablow, corresponding to a keyword (e.g., T≦T_(B) and S≦S_(B)) forcontrolling an external output function, to the microphone.

The controller 600 receives an input signal corresponding to the user'sblow via the microphone and identifies whether the input signalcorresponds to a voice interaction or a blow interaction. Diagram 503shows an example where the input signal is a blow interaction. Thecontroller 600 converts the input signal of the blow interaction into asound pressure signal via a sound pressure conversion and compares thesound pressure signal with a command keyword (i.e., a blow keyword) inthe keyword information.

When the controller 600 ascertains that the sound pressure signalmatches a particular keyword of the command keywords, it controls afunction corresponding to the matched command (e.g., switch to aprevious page) as shown in diagram 505. For example, the controller 600can control the page switch for the screen data that is being output(e.g., movement to a previous page according to the command), based onthe recognized command. The controller 600 can also control variousfunctions described in Table 1, according to corresponding recognizedcommands.

In addition, although it is not shown in FIG. 5, the controller 600 canoutput the execution information 850 on at least one of the internalscreen data and the external screen data, as shown in diagram 405 ofFIG. 4, when the controller 600 controls a function based on thecommand.

After controlling a particular function for the external output as shownin diagram 505, the controller 600 can continue controlling anotherfunction. The user can call the executable command information 800 byinputting his/her voice corresponding to a magic keyword or can directlycontrol another function by inputting his/her voice (i.e., a voiceinteraction or a blow interaction) corresponding to a command keyword.Therefore, the controller 600 can compare the input signals, receivedwhen the interaction receiving mode has been activated, with both themagic keywords and the command keywords. After that, the controller 600can perform a corresponding function according to the matched keyword.

On the contrary, when a corresponding function for the external outputhas been controlled as shown in diagram 505, the user may continueviewing corresponding screen data. When the controller 600 does notreceive a new input signal via the microphone within a preset timeperiod, it can switch the interaction reception mode from the activationstate to the deactivation state.

Meanwhile, FIG. 5 shows an example where the mobile device controls anexternal output function according to a command keyword based on a blowinteraction that is input via the internal microphone. In an exemplaryembodiment of the present invention, the mobile device can be set insuch a way that a blow interaction can perform only one particularfunction. That is, setting a command keyword according to a blowinteraction described in Table 1 is omitted, all types of blowinteractions can be set to directly perform one particular function.

Although it is not shown in FIG. 5, the mobile device can be operatedvia at least two or more microphones. For example, when the mobiledevice includes two microphones, such as first and second microphones,the first and second microphones may be installed at the left and rightsides, as shown in FIG. 1, with respect to the front of the mobiledevice. In that case, the mobile device can be set to perform onefunction or at least one function according to a command keyword, bymicrophones, with respect to blow interactions.

The mobile device can omit the process of setting a command keywordaccording to blow interactions. However, the mobile device can setdifferent functions to the first and second microphones, respectively,with respect to all types of blow interactions, as described in Table 1.For example, the first microphone may be set as movement to a previouspage and the second microphone may be set as movement to the next page.In that case, when a blow interaction is created via the firstmicrophone, the controller 600 controls the function of movement to aprevious page, set to the first microphone. Likewise, when a blowinteraction is created via the second microphone, the controller 600controls the function of movement to the next page, set to the secondmicrophone.

Next, various types of functions by command keywords, as described inTable 1, can be assigned to the first and second microphones,respectively. Therefore, when a blow interaction is created via thefirst microphone, the controller 600 identifies a command of the commandkeywords, matched with the blow interaction, with respect to the firstmicrophone, and then performs a corresponding function. Likewise, when ablow interaction is created via the second microphone, the controller600 identifies a command of the command keywords, matched with the blowinteraction, with respect to the second microphone, and then performs acorresponding function.

FIG. 6 illustrates a flow chart that describes a method for controllingan external output of the mobile device by recognizing a user'sinteractions, according to an exemplary embodiment of the presentinvention.

Referring to FIG. 6, a user can activate the projection function of themobile device via an input mechanism of the mobile device, for example,an input unit 200, a display unit 100, microphones, etc. In that case,the controller 600 initiates an external output mode by operating theprojector module 300 according to a user's request and projecting screendata for an application onto an external screen 900 via the projectormodule 300 in step 601. Before operating the projector module 300, themobile device may be displaying particular screen data for anapplication, requested by the user, on the display unit 100.

After that, the controller 600 activates the microphone in step 603. Inan exemplary embodiment of the present invention, the controller 600 canautomatically activate the microphone when operating the projectormodule 300. Alternatively, the controller 600 can manually activate themicrophone when the user creates an input signal for operating themicrophone. That is, the controller 600 can operate the microphone in analways listening mode or normal listening mode, according to receivingmode information in preset optional information.

Next, the controller 600 detects a user's interaction input to themicrophone during the external output in step 605. That is, the user caninput his/her voice or blow for controlling the external output to themicrophone of the mobile device. It should be understood that the usercan also input his/her voice or blow to a microphone of an externaldevice. The controller 600 can receive an input signal, such as a user'svoice or blow, etc., via the microphone. In that case, the controller600 recognizes that an interaction according to the input signal iscreated.

The controller 600 analyzes the interaction according to the inputsignal in step 607. The controller 600 extracts a signal received by themicrophone and determines whether the input signal corresponds to avoice interaction based on the extracted signal in step 609.

When the controller 600 ascertains that the input signal corresponds toa voice interaction at step 609, the controller 600 controls theexternal output function according to the voice interaction, based onpreset keyword information, in step 611. This has already been describedabove with reference to FIG. 4. A detailed description regarding themethod for controlling an external output after the interaction analysiswill be made further below with reference to FIG. 7.

On the contrary, when the controller 600 ascertains that the inputsignal does not correspond to a voice interaction at step 609, thecontroller 600 further determines whether the input signal correspondsto a blow interaction in step 613. When the controller 600 ascertainsthat the input signal corresponds to a blow interaction at step 613, thecontroller 600 controls the external output function according to theblow interaction, based on preset keyword information in step 615. Thishas already been described above with reference to FIG. 5. A detaileddescription regarding the method for controlling an external outputafter the interaction analysis will be made further below with referenceto FIG. 7.

On the contrary, when the controller 600 ascertains that the inputsignal does not correspond to a blow interaction at step 613, thecontroller 600 ignores the input signal of a corresponding interactionin step 617. For example, when the mobile device outputs screen dataaccording to the reproduction of a particular moving image, audio datais output via the speaker and, accordingly, the audio data output fromthe speaker may be input to the microphone of the mobile device. In thatcase, the controller 600 can ignore the input signal, which is outputfrom the speaker and then re-input to the microphone, and can receiveonly a user's voice or blow. This can be achieved by a barge-infunction.

FIG. 7 illustrates a flow chart that describes a method for controllingan external output of the mobile device, based on microphone-basedinteractions, according to an exemplary embodiment of the presentinvention.

Referring to FIG. 7, the controller 600 detects an input signal-basedinteraction via the microphone when the mobile device is operated in anexternal output mode in step 701. The controller 600 analyzes theinteraction and identifies a type of the interaction in step 703. Forexample, the controller 600 can determine whether the interaction is avoice interaction or blow interaction. Since the analysis anddetermination processes of an interaction were described above withreference to FIGS. 3 to 6, their detailed descriptions are not repeatedbelow.

After determining the type of the interaction, the controller 600performs a conversion for the input signal corresponding to the type ofthe interaction in step 705. For example, when the type of theinteraction is a voice interaction, the controller 600 converts theinput signal into a text signal via a STT conversion mode. Likewise,when the type of the interaction is a blow interaction, the controller600 converts the input signal into a sound pressure signal via a soundpressure conversion mode. Since these conversion processes weredescribed above with reference to FIGS. 3 to 6, their detaileddescriptions are not repeated below.

After completing the conversion process for the input signal, thecontroller 600 determines whether an interaction receiving mode isactivated or deactivated in step 707. That is, the controller 600determines whether an interaction receiving mode is activated by thecreation of an interaction corresponding to a user's magic keywordbefore the interaction is transferred from the microphone.

When the controller 600 ascertains that an interaction receiving mode isdeactivated at step 707, the controller 600 compares the converted textsignal or sound pressure signal (hereinafter called a ‘convertedsignal’) with the keyword information in step 709. In particular, thecontroller 600 can compare the converted signal with a magic keyword ofthe keyword information. The controller 600 determines whether theconverted signal matches a magic keyword of the keyword information instep 711.

When the controller 600 ascertains that the converted signal does notmatch a magic keyword of the keyword information at step 711, thecontroller 600 performs a corresponding function in step 713. Forexample, the controller 600 ignores an input signal input to themicrophone. In addition, the controller 600 displays guide information,stating that the user's requested interaction does not match presetkeyword information, on at least one of the internal screen data andexternal screen data, and may also outputs an alert sound via thespeaker.

On the contrary, when the controller 600 ascertains that the convertedsignal matches a magic keyword of the keyword information at step 711,the controller 600 activates an interaction receiving mode in step 715.As described in the section referring to diagram 403 of FIG. 4, thecontroller 600 can output the executable command information 800 on atleast one of the internal screen data and external screen data,according to the preset display information. After activating aninteraction receiving mode at step 715, the controller 600 returns tostep 701 where the controller 600 waits for a new interaction. When thecontroller 600 detects a new interaction, the controller 600 performsthe processes described above.

Meanwhile, when the controller 600 ascertains that an interactionreceiving mode is activated at step 707, the controller 600 compares theconverted signal with the keyword information in step 721. Inparticular, the controller 600 can compare the converted signal with acommand keyword of the keyword information. The controller 600determines whether the converted signal matches a command keyword of thekeyword information in step 723.

When the controller 600 ascertains that the converted signal does notmatch a command keyword of the keyword information at step 723, thecontroller 600 performs a corresponding function in step 725. Forexample, the controller 600 ignores an input signal input to themicrophone. In addition, the controller 600 displays guide information,stating that the user's requested interaction does not match presetkeyword information, on at least one of the internal screen data andexternal screen data, and also outputs an alert sound via the speaker.

On the contrary, when the controller 600 ascertains that the convertedsignal matches a command keyword at step 723, the controller 600controls an external output function according to a correspondingcommand keyword in step 727. When the controller 600 searched for acommand keyword matching the converted signal, the controller 600extracts a function assigned to the command keyword. After that, thecontroller 600 creates a control interaction according to the extractedfunction and controls an external output function. As described in thesection referring to diagram 405 of FIG. 4, the controller 600 canoutput the execution information 850 on at least one of the internalscreen data and external screen data, according to the preset displayinformation.

As described above, the method and system, according to exemplaryembodiments of the present invention, can allow the user to simplycontrol a function for screen data that is being output, via microphonesinstalled as a component of the mobile device, irrespective of themobile device's environment to output the screen data. The method andsystem according to exemplary embodiments of the present invention canallow the user to control an external output function, via themicrophones installed as a component of the mobile device or externaldevices, without contacting the mobile device, so that the screen datacan be projected to an external screen without being shaken or varyingits location.

In addition, the method and system, according to the exemplaryembodiments of the present invention, can simply create controlinteractions when the mobile device performs an external outputfunction, based on internal or external microphones, irrespective of auser's environment such as a dark place or a bright place, and controlsvarious functions for the screen data output to an external screen,where the various functions include channel switch, screen switch, pageswitch, increase/decrease of volume, Fast Forward (FF), REWind (REW),pause, playback, image switch, slide show, etc.

The above-described methods according to exemplary embodiments of thepresent invention can be implemented in hardware or as software orcomputer code that can be stored in a recording medium such as a CompactDisc (CD) ROM, an RAM, a floppy disk, a hard disk, or a magneto-opticaldisk or downloaded over a network, so that the methods described hereincan be rendered in such software using a general purpose computer, or aspecial processor or in programmable or dedicated hardware, such as anApplication Specific Integrated Circuit (ASIC) or a Field ProgrammableGate Array (FPGA). As would be understood in the art, the computer, theprocessor or the programmable hardware include memory components, e.g.,a RAM, a ROM, a Flash, and the like. That may store or receive softwareor computer code that when accessed and executed by the computer,processor or hardware implement the processing methods described herein.In addition, it would be recognized that when a general purpose computeraccesses code for implementing the processing shown herein, theexecution of the code transforms the general purpose computer into aspecial purpose computer for executing the processing shown herein.

While the invention has been show and described with reference tocertain exemplary embodiments thereof, it will be understood by thoseskilled in the art that various changes in form and details may be madetherein without departing from the spirit and scope of the invention asdefined in the appended claims and their equivalents.

What is claimed is:
 1. A mobile device comprising: a projector modulefor outputting screen data from the mobile device to an external screen;a storage unit for storing a preset keyword information and a presetoptional information related to an external output function of themobile device; a microphone for receiving an interaction; and acontroller for activating the microphone according to the presetoptional information when the mobile device enters an external outputmode, for performing an external output operation in the external outputmode, for activating an interaction receiving mode when detecting anaudio signal corresponding to the preset keyword information, the audiosignal being input to the microphone, for detecting, in the interactionreceiving mode, the interaction input to the microphone to extract aninput signal from the detected interaction, for identifying a type ofthe detected interaction based on the input signal, for performing aconversion for the input signal corresponding to the type of thedetected interaction, and for controlling the external output accordingto a converted input signal.
 2. The mobile device of claim 1, whereinthe type of the detected interaction comprises one of a user's voiceinteraction and a user's blow interaction.
 3. The mobile device of claim1, wherein the controller creates a control interaction based on theconverted input signal and controls the external output based on thecontrol interaction.
 4. The mobile device of claim 1, wherein thecontroller: determines whether the interaction receiving mode isactivated or deactivated; compares the audio signal with the presetkeyword information when the interaction receiving mode is deactivated;and activates the interaction receiving mode when the audio signalmatches the preset keyword information.
 5. The mobile device of claim 1,wherein the controller: determines whether the interaction receivingmode is activated or deactivated; compares the converted input signalwith command keyword information when the interaction receiving mode isactivated; and creates, when the converted input signal matches thecommand keyword information, a control interaction corresponding to thecommand keyword information.
 6. The mobile device of claim 5, whereinthe controller: searches for, when the type of the interaction is avoice interaction, a voice command keyword matching the converted inputsignal, from the command keyword information.
 7. The mobile device ofclaim 5, wherein the controller: searches for, when the type of theinteraction is a blow interaction, a blow command keyword matching theconverted input signal, from the command keyword information.
 8. Themobile device of claim 3, wherein the controller: identifies a type ofthe interaction, based on a new input signal that is input to themicrophone in the activated interaction receiving mode; performs aconversion for the new input signal in a conversion mode correspondingto the identified type of the interaction; compares the new convertedinput signal with a command keyword information; and controls theexternal output, based on a control interaction corresponding to thecommand keyword information matching the new converted input signal. 9.The mobile device of claim 8, wherein the controller controls to displayexecutable command information on at least one of internal screen data,displayed on the mobile device, and external screen data displayed on anexternal screen, and wherein the executable command information can beexecuted when the interaction receiving mode is activated.
 10. Themobile device of claim 8, wherein the controller: controls to displayexecution information, stating that a function is executed when theexternal output is controlled according to the control interaction, onat least one of internal screen data, displayed on the mobile device,and external screen data displayed on an external screen.
 11. The mobiledevice of claim 1, wherein the controller: turns on a display unit ofthe mobile device when controlling external screen data according to theinteraction in the external output mode; and outputs, when the displayunit is turned on, internal screen data that is one of identical to anddifferent from the external screen data, on the display unit.